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Stennis Space Center 
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- Stennis Space Center, MS 
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- Results 
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Assessment Overview 


Stennis Space Center 




• Objective 

- Compare vendor-provided image coordinates with known 
references visible in the imagery 

• Approach ' v 

- Use multiple, well-characterized sites with >40 ground control 
points (GCPs); sites that are 

• Well distributed 

• Accurately surveyed 

• Easily found in imagery 

- Perform independent assessments with independent teams. Each 
team has slightly different measurement techniques and data 
processing methods. 

• NASA Stennis Space Center 

• South Dakota State University 
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Data Providers 

^ Stermis Space Center 

• DigitalGlobe, Inc. 

- Imagery acquired by the QuickBird sensor 

- Data purchased by NASA through the Scientific Data Purchase 
project 

- Assesement is a continuation from the previous year 

* 

• OSC/ORBIMAGE, Inc. 

- Imagery acquired by the OrbView-3 sensor - 

- Data received through a Space Act Agreement among NASA, 

Orbital Sciences Corporation, and ORBIMAGE, Inc. 

- Independent assessment performed on pre-initial on-orbit checkout 
(pre-IOC) data 
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Stennis Space Center 


Sites 


Brookings and Stennis Ground Control 



Stennis Space Center 


SDSU uses a distribution of 96 
recognizable points, such as road 
intersections, around Brookings 




Both sets of GCPs were RTK GPS located by the SSC survey team to 
absolute horizontal accuracies in the 3-6 cm range 
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Brookings: QuickBird Image and Targets 


Stennis Space Center 


— 


SDSL) Targets 


August 23, 2003 
PAN Standard 


Approximate 
August 23, 2003 
PAN Standard 
Outline 


1 GCP Locations ® Base Stations 


k* . Hi - 


SSHS*,;; 




Includes material © 
Space Imaging, LLC 
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SSC: OrbView-3 Image and Targets 


December 15, 20i 
PAN Basic with J 
Targets Overlaid 


Stennis Space Center 


Copyright 2004 ORBIMAGE Inc. 
All Right Reserved 
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Methods 



Finding Image Coordinates over Brookings 


Cursor Location/Value of Point 33 


November 8, 2004 
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Step 3 


Includes material © Space Imaging, LLC 


Stennis Space Center 


Example from September 7, 2002 
QuickBird imagery over 
Brookings using ENVI 




Step 1 


Step 2 


Disp #1 (8749.250,16600.250) Scrn: R:110 G:110 B:110 

Projection: UTM Zone #14 North 

Map: 678122. 55E, 4904054.85N Meters 

LL: 44°16'4.58"N, 96 o 46'5.70"W 

Data: 249 


Finding Image Coordinates over SSC 



Step 1 


Step 2 


Stennis Space ( 


Example from February 17, 
2002 QuickBird pan-merged 
imagery over SSC 


Includes material © DigitalGlobe™ 


Step 3 
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Additional Notes on Methods 

^ ^ ^ ■ Stennis Space Center 

• At South Dakota State, images were analyzed by three 
individuals using ENVI software 

- Visible points are determined for the group 

- Each individual finds points independently v 

- If individual mistakes are found, individual is asked to re-select the 
point in question 

- Final image points are averaged before comparison with reference 
coordinates and generation of results 

• SSC images were analyzed by a single individual using 
ERDAS IMAGINE software to select image coordinates 
and MATLAB® to generate results 

- Results are reviewed for indications of mistakes 
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Stennis Space Center 


OrbView-3 Geopositional Assessment 

(pre-IOC) 



OrbView-3 Geopositional Assessment 

Notes 

— Stennis Space Center 


• The OrbView-3 images were not delivered as geocorrected 
products as has been the case with JACIE geopositional 
assessments to date 

• OrbView-3 images were delivered as the OrbView-3 Basic 
product, which is not geocorrected but is delivered with 
rational functions for customers to apply 

• The OrbView-3 rational functions were applied for this 
assessment using a local photogrammetrically generated 
DEM for the SSC Fee Area 

• DEM metadata 

- Elevations referenced to ellipsoid 

- Estimated accuracy: 30 cm, LE90 

- Rasterized to 3 m grid 
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Data Acquisitions 

Stennis Space Center 


All acquisitions were Orb View-3 Basic Enhanced, 
panchromatic 

- 25 meters CE 90 product specification 

All over Stennis Space Center, MS 

- September 17, 2003 

- December 12, 2003 — • 

- December 15, 2003 

- December 26, 2003 


OrbView-3 Basic Enhanced: 

• Includes satellite telemetry data, 
rational functions, post 
processed GPS data and 
sufficient metadata to allow 
rigorous photogrammetric 
triangulation, (from product 
catalog) 


January 12, 2004 
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SSC, Sep 17, 2003 - PAN Basic 



Stennis Space Center 


OrbView-3 


Acquisition 

Date 

Imagery Band PAN 

1 1 

Number Tar< 

lets Used 

Error Components 

n 

40 

p H (Bias) 

7.92 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 

Error) 

0.64 m 

St. Dev. Min 
Max Ratio 

0.84 

Vh/0 c 

12.40 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If p H /cr c is greater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

8.32 m 

Empirical CE 95 

8.44 m 


s Geopositional Assessment Vector Plot 



CE 90 8.32 m 
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SSC, Dec 12, 2003 - PAN Basic 



Stennis Space Center 


OrbView-3 

Acquisition 12;12/2003 

Date 

Imagery Band PAN 

I I 

| Number Targets Used 

Error Components 

1 n 

29 

p H (Bias) 

4.69 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 

Error) 

0.50 m 

St. Dev. Min 
Max Ratio 

0.74 

Vh/Oc 

9.43 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If p H /cr c ' s 9 r eate r than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

5.57 m 

Empirical CE 95 

5.68 m 


CE 90 5.57 m 
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SSC, Dec 15, 2003 - PAN Basic 


Stennis Space Center 


OrbView-3 


Acquisition 12/15/2003 

Date 

Imagery Band PAN 

I l 

Number Targets Used 

Error Comi 

ponents 

n | 27 

Ph (Bias) 

9.80 m 

Test for Departure from 
Circular Distribution 

<j c (Circular 
Standard 

Error) 

1.00 m 

I St. Dev. Min 
I Max Ratio 

0.91 

Vh/Oc 

9.83 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If g H /cj c is greater than 0.1, 
then error calculations should 
account for bias. 


Circular Error 

|£/77p#r/ca/ CE 90 

11.11 m 

Empirical CE 95 

11.25 m 


6 Geopositional Assessment Vector Plot 



CE 90 11.11 m 
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SSC, Dec 26, 2003 - PAN Basic 



Stennis Space Center 


OrbView-3 

Acquisition 12/26/2003 

Date 

Imagery Band PAN 

I l 

Number Tart 

jets Used 

Error Components 

n 

29 

Ph (Bias) 

4.38 m 

Test for Departure from 
Circular Distribution 

o’ c (Circular 
Standard 

Error) 

0.53 m 

St. Dev. Min 
Max Ratio 

0.80 

Vh/Oc 

8.28 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Ph/ctc is greater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

4.98 m 

Empirical CE 95 

5.24 m 


CE 90 4.98 m 
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SSC, Jan 12, 2004 - PAN Basic 



Stennis Space Center 


OrbView-3 

Acquisition 

Date 

Imagery Band PAN 

1 1 

Number Targets Used 

Error Com| 

ponents 

~n 1 31 

p H (Bias) 

5.42 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 

Error) 

0.48 m 

St. Dev. Min 
Max Ratio 

0.99 


11.37 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Pr/ctc is greater than 0.1, 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE go 

5.93 m 

Empirical CE 95 

5.96 m 


CE 90 5.93 m 
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No Clear Bias Trend 



Stennis Space Center 


OV-3 Bias Given Orthoiectification with 
Ellipsoidal DBvl 
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Direction of bias (with bias = image - reference) ranged from southeast to 
northwest 
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OrbView-3 Error Scatterplot 


Stennis Space Center 
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Summary 


Stennis Space Center 



OrbView-3 Product 

Acquisition 

Date 

Empirical 
CE 90 (rn) 

Empirical 
CE 95 (m) 

Elevation 
Angle (deg) 


9/17/2003 

8.29 

8.37 

79.3 


12/12/2003 

5.49 

5.66 

65.8 

Panchromatic Basic 

12/15/2003 

11.11 

11.19 v 

52.7 


12/26/2003 

4.98 

5.13 

80.2 


1/12/2004 

5.92 

5.96 

61.6 


• The mean CE 90 of OrbView-3 panchromatic Basic images 
characterized was 7.2 m 

- 95% confidence interval from 4.0 m to 10.3 m 

• All OrbView-3 images characterized in this reporting period met 
ORBIMAGE’s self-stated specifications for Basic Enhanced product 
configuration 
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Extended OrbView-3 Summary 



Stennis Space Center 


OrbView-3 

Product 

Image 

Tracking 

ID 

Acquisition 

Date 

Bias X 
(m) 

BiasY 

(m) 

Mh- 

Bias (m) 

o c - Circular 
Standard 
Error (m) 

Empirical 
CE 90 (m) 

Empirical 
CE 95 (m) 

Elevation 

Angle 

(deg) 

Panchromatic 

Basic 

14442 

9/17/2003 

-5.88 

-5.31 

7.92 

" 0.64 

8.29 

8.37 

79.3 

24790 

12/12/2003 

-4.46 

1.45 

4.69 

0.50 

5.49 

5.66 

65.8 

22760 

12/15/2003 

r 1.21 

-9.73 

9.80 

1.00 

11.11 

11.19 

52.7 

23539 

12/26/2003 

2.11 

-3.84 

4.38 

0.53 

4.98 

5.13 

80.2 

24515 

1/12/2004 

-5.21 

-1.48 

5.42 

0.48 

5.92 

5.96 

61.6 
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Stennis Space Center 



QuickBird Geopositional Assessment 




Data Acquisitions 

Stennis Space Center 


• Acquisitions Types 

- Standard (2A) - 23 meters CE 90 

- Orthorectified (3E - 1 : 1 0,000) - 8.3 meters CE 90 

• Brookings, SD (both panchromatic & multispectral) 

- August 23, 2003 (both Standard & Orthorectified) 

- September 15, 2003 (Standard) • ■ 

- October 21 , 2003 (Standard) 

• Stennis Space Center, MS (panchromatic only) 

- January 10, 2004 ( Standard ) 
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Brookings, Aug 23, 2003 - PAN Standard 



Stennis Space Center 


QuickBird 

Acquisition 

Date 

Imagery Band PAN 

1 1 

Number Tare 

jets Used 

Error Com| 

ponents 

n 

56 

p H (Bias) 

1 1 .24 m 

Test for Departure from 
Circular Distribution 

<j c (Circular 
Standard 

Error) 

1.33 m 

St. Dev. Min 
Max Ratio 

0.79 

V hJ® c 

8.45 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Ph/ctc is greater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

12.67 m 

Empirical CE 95 

12.76 m 


CE go 12.67 m 


x1q6 Geopositional Assessment Vector Plot 
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Brookings, Aug 23, 2003 


MS Standard 

Stennis Space Center 


QuickBird 

Acquisition 

Date 

Imagery Band MS 

1 1 

Number Targets Used 

Error Comi 

ponents 

1 2 

56 

p H (Bias) 

10.33 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 

Error) 

1.81 m 

Sf. Dev. Min 
Max Ratio 

0.98 

V h/o c 

5.71 

St. Dev. Min Max Ratio 
should be at least 0.6 for 
Circular Error assumptions. 

If |j h /CTc ' s greater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE go 

12.78 m 

Empirical CE 95 

12.93 m 


CE go 12.78 m 


x10 e Geopositional Assessment Vector Plot 
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Brookings, Sep 15, 2003 - PAN Standard 



Stennis Space Center 


QuickBird 

Acquisition 9/15(2003 

Date 

Imagery Band PAN 

1 1 

Number Tare 

jets Used 

Error Comi 

ponents 

n 

37 

Vh (Bias) 

16.53 m 

Test for Departure from 
Circular Distribution 

<j c (Circular 
Standard 

Error) 

0.71 m 

St. Dev. Min 
Max Ratio 

0.94 

Vh/Oc 

23.22 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Pr/ctc is greater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

17.40 m 

Empirical CE 95 

17.62 m 


CE 90 17.40 m 


x10 e Geopositional Assessment Vector Plot 



November 8, 2004 


29 



Brookings, Sep 15, 2003 - MS Standard 



Stennis Space Center 


QuickBird 

Acquisition 

Date 

Imagery Band MS 

1 1 

Number Tare 

jets Used 

Error Comi 

ponents 

n 

37 

Ph (Bias) 

16.26 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 

Error) 

1.01 m 

St. Dev. Min 
Max Ratio 

0.91 

I*hIg c 

16.17 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Ph/ctc is greater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

17.34 m 

Empirical CE 95 

17.66 m 


CE 90 17.34 m 


x1q6 Geopositional Assessment Vector Plot 
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Brookings, Oct 21, 2003 - PAN Standard 



Stennis Space Center 



CE 90 13.63 m 


x10 e Geopositional Assessment Vector Plot 
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Brookings, Oct 21, 2003 - MS Standard 



Stennis Space Center 


QuickBird 

AcquIMon 10/21/2003 

Date 

Imagery Band MS 

1 1 

Number Tart 

jets Used 

Error Comi 

ponents 

n 

35 

g H (Bias) 

12.21 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 

Error) 

1.53 m 

St. Dev. Min 
Max Ratio 

0.97 

V c 

7.97 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Mh/ctc ' s greater than 0.1, 
then error calculations should 
account for bias. 


Circular Error 

1 Empirical CE 90 

13.76 m 

Empirical CE 95 

13.77 m 


x10 b Geopositional Assessment Vector Plot 



CE 90 13.76 m 


* Note that CE 90 and CE 95 determined empirically can be 
almost equal if the outermost errors happen to be close 
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SSC, Jan 10, 2004 - PAN Standard 



Stennis Space Center 


QuickBird 

Acquisition vw/2mi 

Date 

Imagery Band PAN 

1 1 

Number Targets Used 

Error Components 

n 40 

Vh (Bias) 

15.41 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 
Error) 

0.54 m 

St. Dev. Min 
Max Ratio 

0.41 

Vh/ctc 

28.47 

St. Dev. Min Max Ratio 
should be at least 0.6 for 
Circular Error assumptions. 

If p H /^c is greater than 0.1, 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

16.27 m 

Empirical CE 95 

16.39 m 


CE 90 16.27 m 


x10 s Geopositional Assessment Vector Plot 
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Brookings, Aug 23, 2003 - 
PAN Orthorectified 


Stennis Space Center 


QuickBird 

Acquisition 8/23/2003 

Date 

, O PAN. 

Imagery Band ORTHO 

1 : 1 

Number Targets Used 

Error Components 

i ■ 

37 

Vh (Bias) 

5.52 m 

Test for Departure from 
Circular Distribution 

o c (Circular 
Standard 
Error) 

1.45 m 

St. Dev. Min 
Max Ratio 

0.63 

Vh/Oc 

3.81 

St. Dev. Min Max Ratio 
should be at least 0.6 for 
Circular Error assumptions. 

If Ph/ctc ' s 9 reater than 0.1, 
then error calculations should 
account for bias. 


Circular Error 

Empirical 

CEqq 

7.93 m 

Empirical 

ce 95 

8.11 m 


CE 90 7.93 m 


xio b 


Geopositional Assessment Vector Plot 



Easting (meters) 


x 10 
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Brookings, Aug 23, 2003 
MS Orthorectified 


Stennis Space Center 



QuickBird 

Acquisition sl23/2003 

Date 

Imagery Band MS-ORTHO 

1 1 

Number Tart 

jets Used 

Error Com| 

ponents 

n 

37 

Ph (Bias) 

' 5.34 m 

Test for Departure from 
Circular Distribution 

a c (Circular 
Standard 

Error) 

1.57 m 

St Dev. Min 
Max Ratio 

0.63 

Vh/ctc 

3.40 

St. Dev. Min Max Ratio should 
be at least 0.6 for Circular 
Error assumptions. 

If Ph/ctc ' s g reater than 0.1 , 
then error calculations should 
account for bias. 


Circular Error 

Empirical CE 90 

7.50 m 

Empirical CE 95 

8.43 m 


CE 90 7.50 m 


x10 e Geopositional Assessment Vector Plot 
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Bias Trend 


Stennis Space Center 



QB Panchromatic Standard Bias 
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Bias trends to the southwest (with bias = image - reference) for all 
Standard images characterized 
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QuickBird Error Scatterplot 


Stennis Space Center 


QuickBird Scatterplot (PAN only) 
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Summary 


Stennis Space Center 


QuickBird Product 

Acquisition 

Date 

Empirical 
CE 90 (m) 

Empirical 
CE 95 (m) 

Elevation 
Angle (deg) 

Panchromatic Standard 

8/23/2003 

12.67 

12.76 

76.8 

9/15/2003 

17.40 

17.62 

83.3 

10/21/2003 

13.63 

13.72 

81.3 

1/10/2004 

16.27 

16.39 

89.2 

Panchromatic Orthorectified 

8/23/2003 

7.93 - 

8.1 


Multispectral Standard 

8/23/2003 

12.78 

v 12.93 

76.8 

9/15/2003 

17.34 

17.66 

83.3 

10/21/2003 

13.76 

13.77 

81.3 

Multispectral Orthorectified 

8/23/2003 

7.50 

8.43 

76.8 


The mean CE 90 of QuickBird panchromatic Standard images characterized was 15.0 m 

- 95% confidence interval from 1 1 .5 m to 18.5 m 

• The mean CE go of QuickBird multispectral Standard images characterized was 14.6 m 

- 95% confidence interval from 8.7 m to 20.6 m 

• The single panchromatic Orthorectified image had CE 90 of 7.9 m, and the single 
multispectral Orthorectified image had CE 90 of 7.5 m 

• All QuickBird images characterized in this reporting period met specifications 

- Standard 2A: CE 90 23 m, Orthorectified 3E: CE 90 8.3 m 
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Extended QuickBird Summary 



Stennis Space Center 


QuickBird Product 

Image 

Tracking 

ID 

Acquisition 

Date 

Bias X 
(m) 

Bias Y 
(m) 

p H - Bias 
(m) 

ct c - Circular 
Standard 
Error (m) 

Empirical 
CE 90 (m) 

Empirical 
CE 95 (m) 

Elevation 

Angle 

(deg) 

Panchromatic 

Standard 

75234 

8/23/2003 

-7.20 

-8.63 

11.24 

- 1.33 

12.67 

12.76 

76.8 

76412 

9/15/2003 

-13.86 

-9.01 

16.53 

0.71 ' 

17.40 

17.62 

83.3 

83586 

10/21/2003 

-9.47 

-7.70 

12.20 

1.09 

13.63 

13.72 

81.3 

98196 

1/10/2004 

-14.93 

-3.80 

15.41 

0.54 

16.27 

16.39 

89.2 

Panchromatic 

Orthorectified 

88508 

8/23/2003 

-5.47 

-0.71 

5.52 

1.45 

7.93 

8.11 

76.8 

Muitispectral 

Standard 

75234 

8/23/2003 

-6.94 

-7.66 

10.33 

1.81 

12.78 

12.93 

76.8 

76412 

9/15/2003 

-14.02 

-8.23 

16.26 

1.01 

17.34 

17.66 

83.3 

83586 

10/21/2003 

-9.76 

-7.33 

12.21 

1.53 

13.76 

13.77 

81.3 

Muitispectral 

Orthorectified 

88508 

8/23/2003 

-5.33 

0.31 

5.34 

1.57 

7.50 

8.43 

76.8 
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